Window on Higgs Boson: Fourth Generation V Decays Revisited 
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Direct and indirect searches of the Higgs boson suggest that 113 GeV < run ^170 GeV is likely. 
With the LEP era over and the Tevatron Run II search via pp — » WH + X arduous, we revisit a 
case where WH or ZH+ jets could arise via strong b b pair production. In contrast to 10 years ago, 
the tight electroweak constraint on t'-b' (hence t'-t) splitting reduces FCNC b' — > bZ, bH rates, 
making b' — > cW naturally competitive. Such a "cocktail solution" is precisely the mix that could 
evade the CDF search for b' — » bZ, and the b' may well be lurking below the top. In light of the 
Higgs program, this two-in-one strategy should be pursued. 
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The search for the Standard Model (SM) Higgs bo- 
son is the holy grail of present day high energy physics. 
The global electroweak (EW) fit, assuming SM, gives |l]] 
m H = 62±|| GeV, or m H < 170 GeV at 95% confidence 
level (CL). Together with the direct search limit || of 
run > 113.3 GeV at LEP, the Higgs boson seems "just 
around the corner" . Surely enough, just before LEP shut- 
down, there were exciting hints ||,[4| for ran — 115 GeV, 
and the shutdown was postponed by a month. The extra 
data collected did not greatly strengthen the case, but 
it was argued that a further run with about 200 pb _1 
per experiment at \fs — 208.2 GeV might lead to a ha 
discovery [Q. Unfortunately, the wish was not granted, 
fearing it might jeopardize the schedule for LHC — the 
main goal of which is the Higgs boson! As LEP is now 
closed, we have to wait for Run II at Tevatron which 
starts in 2001, or the turn on of LHC in 2005. 

Not surprisingly, Higgs boson search in the 110-190 
GeV range is now one of the prime objectives for Teva- 
tron Run II. The main process, qq — > V* — > VH (V = W, 
Z) followed by H — > bb and leptonic V decays pj , suffers 
from a small electroweak cross section: <r(qq — > W^H) ~ 
0.3 to 0.002 pb at Run II energies for 100 GeV < m H < 
200 GeV. A very recent study || claims that, with suit- 
able cuts that exploit the kinematic differences between 
signal vs background, a statistically significant signal can 
be extracted if one has sufficient luminosity. However, 
with the 2 fb _1 expected by end of 2002, one can barely 
rule out the LEP hint of m H ~ 115 GeV at 95% CL, 
while to have a 5er discovery, one would need 10-15 fb _1 . 
Since this seems to be the amount of data one may re- 
alistically expect before the start of LHC physics, the 
Tevatron path to Higgs search is arduous. 

It is clear that a premium should be placed on pro- 
cesses with higher cross sections (but manageable back- 
ground) that could aid the Higgs search at the Teva- 
tron. In this Letter we revisit a case § where the WH 
or ZH signatures arise from strong pp — > b'b 1 + X pro- 
duction of sequential fourth generation b' pairs, followed 
by b' — > cW, bZ, bH decays that are all of comparable 



strength. The effective pp — > WH + X or ZH + X cross 
sections could be at a few pb -1 . 

The main new observations we make are as follows. 
EW precision data give stringent constraint on mp — 
my For my < m t , the t'-t splitting is considerably 
smaller than assumed in |7|], and Glashow-Illiopoulos- 
Maiani (GIM) suppression of b' — > bZ, bH decays is more 
severe ||, hence the b' — > cW channel becomes more 
prominent. Furthermore, recent direct search by CDF 
0| has ruled out b' -> bZ decay for my < 200 GeV 
if B(b' -> bZ) = 100%, but may be evaded if V -> cW 
(but not b' -> bH) dilutes B{b' -> bZ). Note that a dom- 
inant but not predominant 1 1 b' — > cW decay could 
help explain some irregularities of the tt signal. We ar- 
gue that the Cabibbo-Kobayashi-Maskawa (CKM) mix- 
ing element V c y ~ 10~ 3 is plausible, and is just the right 
amount to allow a "cocktail solution" of b' — * cW, bZ 
and bH that can evade the CDF bound. This offers new 
possibilities for Higgs search up to mu < my — mb- 

It is known that, if the b' quark exists and my < m t , 
it may decay in unusual ways: the charged current (CC) 
b' — > tW decay is kinematically forbidden, the b' — > cW 
decay is highly Cabibbo suppressed, hence flavor chang- 
ing neutral current (FCNC) b' — * b transitions would 
likely dominate ]l~2] ]. The suggestion was pursued || by 
collider experiments at Tristan, SLC, LEP and Tevatron, 
with LEP setting the unequivocal bound of mp > mz/2 
on all new fermions F that couple to the Z. The DO 
Collaboration 0] excluded the range mz/2 < my < 
mz + mi, by a null search for b' — > 67 and b' —> bg. We 
remark that, with iV„ = 3 as measured by SLC and LEP 
since 1989, the existence of a sequential fourth genera- 
tion is not strongly motivated (For a recent review, see 
H). However, the observation of neutrino oscillations 
does imply an enlarged neutrino sector. A more impor- 
tant motivation comes from the intense competition for 
Higgs search as stated above. 

For my > mz + mb, the decay b' — * bZ 0] is expected 
to dominate over the other FCNC decay processes, ex- 
cept for b' -> bH §,0 if my > mH + mb also. Recently, 
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the CDF Collaboration gave an upper limit on the 
product cr(pp — > x [B(b' — > 62)] 2 as a function of my, 
which excludes at 95% CL the range 100 GeV < rrib> < 
199 GeV if B(b' -> 6Z) = 100%. For B{b' -> WJ) ^ 0, so 
long that 0(6' — > 6Z) does not vanish, the CDF bound 
still largely applies since hadronic final states of V — ► bZ 
and bH are rather similar, and in fact the bH mode 
has better 6-tagging efficiency. What CDF apparently 
did not pursue in any detail is the b' — > cW possibility. 
Clearly the 6-tagging efficiency for cW mode would be 
much worse than bZ or bH. Since 6-tagging is an impor- 
tant part of the CDF b' — > bZ search strategy, one may 
evade the CDF search if B(b' — » cW) is sizable. 

Precision EW data provide stringent constraints on the 
fourth generation: there is a 2.5a discrepancy between 
S = -0.07±0.11 j§ and S = 2/3vr = 0.21 for a heavy de- 
generate fourth generation. However, using exact expres- 
sions for gauge boson self-energies for my = my = 150 
GeV, m E = 200 and m N = 100 GeV (E, N are fourth 
generation charged and neutral leptons), one finds ||] 
S s» 0.11 instead of 0.21, and the discrepancy drops be- 
low 2a. Given the excellent agreement between SM and 
EW data, a discrepancy at this level in a few measurables 
is not tantalizing. For S = 0.2, the 2a upper bound on 
T is approximately 0.2 {Sp ss 0.0015). Using the analytic 
expression of Sp we find Aq = \my — my \ < 60 GeV 
and At, = \m E — jti-jv | _ 104 GeV, which can be weak- 
ened if we just take the Sp constraint. At the 2a level 
and for m H < 1 TeV, one finds @ p a = 0.9998^^^2 
or -0.0014 < Sp < 0.0032, hence Aq < 86 GeV and 
Al < 148 GeV. 

In the following, we shall take the conservative range 
Aq = \m t i — my| < 60 GeV. For my < m t , this implies 
that the t'-t splitting is far less j^j than assumed 10 years 
ago @, and FCNC b' -> bZ, bH decays are more GIM 
suppressed. Thus, the CC b 1 — * cW mode, though highly 
Cabibbo suppressed, can be more competitive. Note that 
nit ~ my ~ m t > would in general imply near maximal 
mixing, or V t y — Vfb — 1/V2- 

What is the "natural" strength of T4y? We can- 
not know for certain, but give two plausible arguments 
here: Since each involve two generation jump, perhaps 
V c y ~ V u b\ or one could guess that V c y ~ m s /mb' since 
V c b ~ m s jm,b Both cases suggest V c b> ~ 10~ 3 , 

just what is needed to make b' — > cW ~ 6' — > bZ in 
rate, as we will show. Thus, EW precision data, while 
not strongly supporting the existence of a fourth gen- 
eration, together with the hierarchical pattern of quark 
masses and mixings, lead naturally to the "cocktail so- 
lution" of b' -> cW ~ bZ > bH that can evade CDF 
search for b' — ► bZ. This is in contrast to previous ex- 
pectations (7],[l^,[l4|] that b' — > cW would be considerably 
below &' — ► &Z, 6ff decays. We remark here that com- 
parison of b' — > cW and 6' — > bZ were made recently in 
but not in conjunction with b' — > b/f ; the importance 
of the latter mode was emphasized in |lq] in the con- 
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FIG. 1. The ratio R hz = r(6' -> bH)/T{U -> bZ) vs m B 
for several my values and Aq = ray — m v — 55 GeV. 



text of evading CDF bound on b' — * bZ, but a detailed 
discussion of the "cocktail solution" was not given. 

We perform a one-loop calculation of b' — > 6Z, 6iJ 
using the FeynArts and FeynCalc 17 packages, where 
the full set of diagrams (see Fig. 1 of J7|) are generated 
and computed, and we use the FF-package flq] for our 
numerical analysis. We keep both external and internal 
masses, except the nib (and m c , m u ) which can be ne- 
glected to good approximation. Several analytic and nu- 
merical checks are carried out following |Q,|l2|,^4), with 
complete agreement found. Further numerical checks 
against t — ► off, cZ p9 20 in SM again give full agree- 
ment. In the following, we take 115 GeV < mu < 170 
GeV, m t = 175 GeV, Aq = m v - my < 60 GeV, and 
r C KM = \V c b> /VtbVtb>\ in the 10~ 3 range. 

The CKM factors \VfbV t b>\ ~ |14bT4&'| actually cancel 
in the ratio R hz = T(b' -> bH)/T(b' -> bZ), and it de- 
pends on my, my and m#. In Fig. 1 we show Ry iz vs 
mu for several my values with Aq fixed at 55 GeV. It is 
clear that, for light mn and relatively large my, Rh z can 
be of order 0.5 — 1, which means b' — > bH is competitive 
with b' — > bZ so long that it is phase space allowed 

For the actual branching ratios [^TJ , 



B(b' -> {cW, bZ, bH}) = T(b' -> {cTV, bZ, bH})/T Vl 

we assume T b > = T(b' cIV)+r(6' 6Z) + r(6' 
Since T(b' -> cW) oc |V c y| 2 while T(6' -> {bZ,bH}) oc 
\VtbVtb'\ 2 , the branching fractions depend critically on 
r C KM- In Fig. 2 we illustrate 6(6' -> {cW, bZ, bH}) 
vs r C KM = \V cb ' iVtbVw | for my, m ff , Aq = 130, 115, 
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FIG. 2. Bib' -> {cW,bZ,bH}) vs r CK M for m v , m„, 
A Q = 130, 115, 20 GeV (left) and 160, 130, 40 GeV (right). 
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FIG. 3. 0(6' -y {cW,bZ,bH}) vs. my with m H , A c 
115, 50 GeV for r CK M = 0.002 (left), 0.004 (right). 



TABLE I. Comparison of a(pp -> b'b' W#c6, Zi/66) 
and cr(pp — » IF if, ZH) (in pb) for my, tuh, Aq (in GeV) 
and 7-ckm = \ V cb > /V tb V tb > | taken from Fig. 2. 
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20 GeV and 160, 130, 40 GeV. For r CKM > 3 x 10~ 3 , 
B(b' — ► cW) > 80% which would unlikely survive the 
standard top search. On the other hand, for tckm ~ (1- 
3) x 10" 3 , we find that B(b' -> bZ) ~ 64%-20% (65%- 
26%), B(b' -> cW) ~ 28%-78% (18%-67%), and B(b' -> 
bH) ~ 8.7%-2.7% (16%-6.5%), hence b' -» bZ and cW 
are comparable, and may allow the b' quark to evade the 
CDF b' -> bZ search. 

We illustrate, in Fig. 3, B{b' -► {cW, bZ, bH}) vs my 
for two values of tckm with Aq = 50 GeV held fixed. For 
100 GeV < my < 135 GeV hence 150 GeV < m t , < 185 
GeV, b' — ► bZ, bH are suppressed by small t'-t splitting, 
and b' — > cW predominance can be seen from left-hand 
side of the figures. Away from this range where GIM 
mechanism is severe, B(b' — > cW) decreases as we in- 
crease my while B(b' — > bZ) and B(b' — > W7) grow. It 
appears from this plot that for my > 150 GeV, the three 
decays we are considering have the same order of mag- 
nitude with no single mode fully dominating. For exam- 
ple, for rcKM — 0.004 and my, to# = 170, 115 GeV, the 
modes cW : bZ : bH ~ 2 : 2 : 1 in rate. 

To illustrate that this scenario can evade CDF search 
for b' — ► bZ, we reproduce Fig. 2 of |nj in our Fig. 4. 
The dotted curve is the predicted cross section o~(pp — > 
b'b') at 1.8 TeV, the solid curve corresponds to the 95% 
CL upper limit on a(pp — ► b'b') x [B(b' — > fe^)] 2 . From 
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FIG. 4. Comparison of CDF search for b' bZ and our 
scenario with run = 115, Aq = 50 GeV. The dotted curve is 
the predicted cr(pp — > b'b 1 ) at 1.8 TeV, while the solid curve 
is the 95% CL upper limit on a(pp -> b'b') x [0(6' -> 6Z)] 2 
[10]. The open (black) circles correspond to B(b' — > 6Z) as 
computed in our model for tckm = 0.001 (0.002). 



the crossing of the two curves, CDF rules out my % 
200 GeV if B(V -> bZ) = 100%. Our results are shown 
as open and black circles for tckm = 0.001 and 0.002, 
respectively. For larger tckm values, they drop out from 
the plot. We have held the splitting Aq = m t ' — my = 
50 GeV fixed. This leads to the valley around my ~ 
125 GeV, caused by m t > ~ m t . Very low cross section 
in b' — > bZ mode can evade the search of (nj, but it 
would likely be ruled out by past top search since b' — > 
cW is predominant |ll]] . The reverse situation illustrates 
the power of the CDF study: the region GeV 140 < 
my < 160 GeV for tckm = 0.001 is ruled out because 
B(b' — > bZ) is predominant. However, it is clear that the 
theoretical prediction is smaller than the 95% CL upper 
limit of CDF for a broad range of parameter space, as 
illustrated by the tckm = 0.002 case for my > 140 GeV. 
This is consistent with Figs. 2 and 3. We note that a 
light my around 110 GeV is still allowed, although this 
case would not help in Higgs search. 

We now compare the cross section for pp — > b'b' — > 
(cW)(bH) or (bZ)(bH) with the direct Higgs production 
mechanism pp — > WH , ZH . For illustration and clarity, 
we recapitulate our numerical results from Fig. 2 for Run 
II energies (2 TeV) at Tevatron in Table I. The cross sec- 
tions for pp — > WH, ZH and pp — > b'b' are taken from 
p2| and p3[ , respectively. It is clear that the cross sec- 
tions for WHcb or ZHbb are larger than the correspond- 
ing ones for direct associated WH or ZH production, 
unless r CK M = \V c b' /V t bV t y \ becomes considerably larger 
than few xlO -3 , or when b' — > bH is kinematically sup- 
pressed. Thus, our suggestion should be welcome news 
for the Higgs search program at Tevatron Run II. In any 
case, the search for b' below the top should continue by 
taking into account the b' — > cW mode. By so doing, one 
may uncover the Higgs boson! 

Curiously, there are some indications that the "cock- 
tail solution" of b' — > cW, bZ and bH should be taken 
seriously and hence revisited even for Run I data. It 
is known that the tt events at the Tevatron have some 
irregularities that are, though not yet statistically sig- 
nificant, somewhat tantalizing. First, both CDF and DO 
pij report a lower m t ~ 167-168 GeV in the dilepton 
channel, where 6-tagging is not used. Second, for single 
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lepton plus jets channel, DO and CDF [29] are in good 
agreement on mt, but the CDF cross section extracted 
from soft lepton tag (SLT) is almost twice as high from 
the displaced vertex (SVX) tag, with fitted mt as low 
as 142 GeV! Third, the all hadronic study of CDF |§6), 
which relies heavily on 6-tagging, gives m t ~ 186 GeV, 
the highest of all studies. Interestingly, if one demands 
two SVX-tagged 6-jets for single lepton plus jets sample, 
the fit following CDF dilepton procedure also gives a high 
mass of mt ^ 182 GeV @. 

For sake of illustration, we show that the combination 
m t ~ 175 GeV and m v , m v ~ 160, 210 GeV, with 
t, t' -> bW §7| and the "cocktail solution" of b' -> cW ~ 
bZ > bH, can account for these curiosities. For dileptons 
without 6-tagging, one largely probes bbW + W~ for top 
and t' , and ccW + W~ for b' . One would get lower "m t " 
and a somewhat larger cross section. For single lepton 
plus jets with SVX 6-tag, one is less sensitive to b'b' , 
thereby getting an average "m t " . However, applying SLT 
tag but no SVX tag, one is then sensitive to both b and 
c semileptonic decays with similar efficiencies, and one 
would be more sensitive to b' — > cW decay which has 
larger b'b' cross section and a lower fitted "m t ". For 
all hadronic final state, since one demands SVX 6-tag 
to suppress QCD background, one is more sensitive to 
t, t' — > bW hence a higher "mt" is found. 

The pattern in cross sections could also be reflecting 
the presence of both b' and t' besides the top, as al- 
ready stated in the larger SLT vs SVX tagged cross sec- 
tion. The dilepton and all hadronic cross sections are 
also somewhat larger than theory expectation of order 
5 pb _1 . However, not much more can be said because 
of experimental errors at the Run I level of statistics. 
One would also need detailed knowledge of experimental 
efficiencies. Although one cannot draw a definite con- 
clusion, it may still be worthwhile even to reinvestigate 
the Run I "if" data, keeping in mind the possibility of 
the "cocktail solution" : There may actually be charm jet 
content in tt-like events. At Run II, such a study would 
be imperative, for not only one would have the statis- 
tical power to distinguish, a more exciting Higgs search 
program could be at stake! One could be discovering the 
Higgs together with two new quarks. 

We have shown in this analysis that, once the con- 
straints from precision measurements are taken into ac- 
count, my ~ m t ' ~ m t could be the case. This sup- 
presses FCNC b' -> bZ, bH decays so the CC b' -> cW 
decay becomes important. It should be welcome since 
this is just what is needed to evade the CDF null search 
for b' — > bZ. In a rather plausible parameter space and 
if the GIM suppression of FCNC modes is not overly 
strict, one can have the "cocktail solution" of b' — > cW ~ 
bZ > bH, and there could be actual charm jet content 
of observed it events. Such a signal should be consid- 
ered for better scrutiny of top- like events, and might un- 
cover the Higgs boson handily at Tevatron Run II via 



pp — * cbWH + X or bbZH + X signatures. 
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